DOCOHBHT BESOaS 



3D 163 084 



IB OOe 223 



A 0TB OR 
TITLE 



IHSTITUTION 
POB DftTi; 
NOTE 

AVAILABLE FROH 



EDRS PRICE 
DESCRIPTOliS 



IDENTIFIERS 



LaDDholli, Gerald V, 

Reviev of Studies EmploiiDg GRE Scores ic Predicting 
Success in Graduate Study 1952-1967. Graduate fiecord 
ExaminatiDDs Special Bepcrt Nutter 68-1, 
Educational Testing Service* Piincet:»n, N,J. 
nar 68 
41 p. 

Graduate R^BCord Exa«iBaticc£, Educational Testing 
Service* Princeton, Nev Jersey C8541 l£iee vbile 
supplies last) 

HF-$0,a3 HC-$2,06 plus Pcstaq<*, 

Academic Acbxevenent ; Acbicveaert lests; Annotated 
Bibliographies; Aptitode Tests; ^College Entrance 
Ex 3ii nations; College ea jcrs; Evaluation Criteria; 
Foreign Students; Grade pcint Average; ^Graduate 
Study; Higher E due a tics; * Predictive Validity; 
*Ee search Reviews (Eu tlicat ions) ; * Success Factors; 
♦Test validity 

♦Graduate Record ExaoiBatioBs 



ABSTRACT 
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usually more predictive in the physical sciences; |3) advanced test 
scores in the appropriate subject vere useftl predictors and improved 
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(4) best prediction vas obtained when undergraduate grades and test 
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INTRODUCTION 



Studies conducted prior to 19^1 concerning the effectiveness ol 
(Graduate Record Examimtion? in predicting graduate school success 
were suinmarized by Lannho'^m and Schrader (16) . That report is now 
out of print. Since that timej significant changes have been made 
in the examinations. The number of graduate schools using the test 
scores in evaluating the fitness of applicants for admission has 
increased greatiy. Therefore, a review of studies undertaken since 
the l95l summary was published seems appropriate. 

This report reviews some thirty-six different studies which 
employed C31E scores in predicting success in grac?uate study* It 
includes the unpublished studies brought to the attention of the 
Graduate Record Examinations office at Educational Testing Service* 

It is hazardous to atteir5}t to formulate generally applicable 
conclusions from tha findings of the many and varieJ studies covered 
in this report. However, a few summary statements seem warranted 
and may prove useful. 

In general, students with higher test scores perform 
at a higher level in graduate study than do those with 
lower test scores. Since other factors also affect 
actual performance, this relationship is by no means 
perfect and often varies from department to department 
and from one graduate school to another. 
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Tie Verbal Ability score tends to be most higWj related 
to performance in subjects of a descriptive nature (e.g., 
the humanities) * The Quantitative Ability score is usually 
more predictive in the physical sciences. In some instances, 
ho*feTer, li . le difference ime found between the predictive 
ability of tliese two scores* A combination of tiie two usuaJJjr 
resulted in in inprovement ir predictive effectiveness. 

Hie scora on ar. Advanced T^it in th^^ appropriate subject 
field waa found to be a uoeJtol predictor and, when used 
with tl.:i ^t:!tude Tr^r^'. scores, inproved the correlation 
with performance i„i graduiite study. 

Wh9n the undergraduate record and test scores wero used 
in combination, the predictive effectiveness was btitter 
than when either was used alone* 



Variations 

Reading the abstracts presented in this report will reveal that 
the studies varied in a number of respects. Although most of the 
investigators analyzed their data separately for diff^srent subject 
fields, a few of them pooled data for several disciplines. With the 
exception of the follow-up studies of National Science fbundation 
fellowship awardees, however, no study included pooled data from more 
than one graduate school. 

The most frequently used meaaui^e of success was the graduate 
school grade-point average of the student. However, some inves* 
tigators enployed special ratings by the faculty, a few used per- 
formance on a local examination for doctoral candidates, and four 
used attainment of the Ph*D. degree, or the meeting of all require- 
ments for it, as the criterion of success. 

There were variations also in the data analysis methods used to 
determine effectiveness of the test scores in predicting success in 
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graduate study* The most commonly used technique was correlational 
analysis* However, a few investigators made direct conparisons of 
the average test scores for the students in tkjo or more groups 
classified according to broad levels of graduate school perfoi*mance* 
Hiese differences in the nature of the studies may account j in 
partj for inany of the different findings* 

Persistent Problems 

A review of these studies also shows the persistence of certain 
problems* One is the small n\imber of cases available* Because types 
of students sought, programs of study, and performance standards vary 
not only between universities but also from one department to another, 
it is best to conduct selection evaluation studies by department* How- 
ever, when this is done, the number of graduate students accepted each 
year is often too small to make reliable statistical studies feasible* 
Thus, in many departments it tsJces several years to accomulate enough 
cases for a study that will yield meaningful results* Also, if some 
of the students to be included in the study began graduate work several 
years earlier than others, it may not be appropriate to pool their data,^ 
particularly if admission requirements, curricula, or performance stan- 
dards have changed during the period of time under consideration* 

Another problem is the lack of a satisfactory single index of the 
effectiveness of the predictor(s) in forecasting success in graduate 
study* The correlation coefficient is the most commonly used statistic* 
Yet, it is difficult for the person untrained in statistics to interpret, 
and it should be interpreted with some caution when used in prediction 
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studies at the graduate level. Although it is quite sound for expressing 
the relationship between two variables (e.g.^ predictor and criterion), 
it is sensitive to restriction in range. Therefore, it seldom produces 
high values for highlj selected groups, or for groups for whom criterion 
values (e«g«j grades) have little dispersion* 

A further— and crucial — problem arises in the measures of graduate 
school success* T^ically, the only evaluation of performance available 
is the grade-point aver£tge« Although the grades assigned do represent 
faculty Judgjnents of student performance, they indicate performance only 
in courses taken. TOo, the grades seldom have much rangej except for 
the occasional student given an unsatisfactory grade, most of the grades 
are A's or B's* For these and other reasons, many investigators feel 
that factors other than course grades should be used in Judging degree 
of success in graduate study. 

Finally, even though the undergraduate record is viewed generally 
as an iirportant index of graduate study potential, no more than one- 
third of the studies reviewed herein included it anwng the predictor 
variables used. This is both surprising and disappointing. Earlier 
studies have demonstrated its usefulness despite its low reliability 
and variability from one college to another* Indeed, the valuo of 
CRE test scores in the selection of graduate students is usually 
considered to lie in their contribution as data supplementary to the 
undergraduate record. The effectiveness of the test scores is properly 

i 

judged by how much they Inprove prediction and liot by how well they 
will do the job alone. 
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One further word of caution. It would not be safe to assume that 
the results of any of these studies wouxd apply xn aU subjects in all 
graduate schools* However, a careful study of the findings may yiel^ 
suggestions to individual departments for designing and conducting 
their own studies. 



The remainder of this report is presented in four sections* 
To assist the reader primarily interested in the selection 
of students for graduate study in a particular discipline, 
the findings of the studies are assembled and suinmarized 
briefly by subject field in the section iinmediately following 
this introduction. The other three sections contain abstracts 
of the individual studies. In the first of these are studies 
eniploying varied criteria of success. In the second are stu- 
dies eii5)loying only the grade-point average as criterion* The 
final section reports on two studies of the problem of predic- 
ting graduate school success of foreign students* 
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SUMMARY OF FINDINGS BY MJOR FIELD OF STUDY 



(Margin numbers correspond to abstract numbers 
in following sections, pages 19 to 38.) 



Agronomy 



A significant correlation of .30 was found between 
Quantitative Ability scores and faculty ratings of 
graduate school performance in agronoir^y at Purdue 
University. 



Art 



31 At Sacramento State College uimsualiy high correlations 
were obtained between Aptitude Itest scores and graduate 
grade-point averages. The correlations for Verbal 
Ability and Quantitative Ability were each .72. These 
correlations were found to be statistically significant, 
but it should be noted that there were only lU students 
in the group. 



Biology 



2a 



Two of the studies reviewed included the field of biology, 
Fnr National Science Etoundation fellowship winners, 
Creager used doctorate attainment as the criterion and 
pooled cases from different institutions. He found 
higher rates of attainment among those with high test 
scores than among those with lower test scores. In 
general, the three test scores showed similar positive 
correlations with the criterion, with a con5)osite of 
the three yielding somewhat higher prediction. 

A study at Florida State University, involving only 19 
biological sciences students, prociuced a correlation of 
.317 between Verbal Ability scores and graduate grade- 
point averages. 



Business 
Adminis** 
tration 



31 For a group of 3$ students in this field at Sacramento 
State College, a correlation of .36 was obtained between 
Verbal Ability scores and graduate average grades. 



Chemistry 



Several of the studies reviewed involved separate analyses 
for graduate students in chemistry. Although the predic- 
tors, the criteria of success, and the methods of data 
analysis varied, positive relationships were found between 
test scores and level of performance in graduate study in 
all of these studies. 
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Chemistry 3 k study at Yale classified students in three levels 

tcont. J according to a combination of grades and faculty 

ratings.' When the students were also classified 
into three groups according to their scores on the 
Advanced Chemistry Test, a close correspondence was 
observed between the tHo classification bases. 

ii Creager's study of National Science Foundation 
fellowship winners included both the /^titude 
Test and the Advanced Chamistry Test and used 
doctorate attainment as the criterion. Tt\e 
correlations were somewhat different for males 
than for females but for each groiap the Advanced 
Chemistry Test was the best predictor. For males 
the correlation was .3lj it was ,37 for females. 

The other studies did not use Advanced Chemistry Test 
10 scores. A study at the University of Southern California 
yielded correlations of .U2 and .55 respectively for the 
Verbal Ability and Quantitative Ability scores with a 
2 departmental background examination. Besco at Purdue 
obtained a correlation with special ratings of .23 for 
Verbal Ability and .27 for Quantitative Ability. 



Economics 25 The one study that dealt with the field of economics 

reported a positive correlation of .hO between the 
Verbal Ability score and graduate grade^^oint average 
for the students in that subject. 



Education Thirteen of the studies reviewed in this report were 

concerned with or included graduate students in edu- 
cation. Ten of the investigators used grade^^oint 
averages as the criterion of success in graduate study. 
Nearly all used the /^titude Test scores as predictors 
but a few used scores on the Advanced Education Test. 

8 At the University of Southern California, Law obtained 
a correlation of .72 between the Verbal Ability score 
and the total score on the local coir5}rehensive exami- 
nation. Verbal Ability also predicted best the exami- 
nation rating in Educational Psychology and Guidance 
(r=.68) and that in History and Philosophy of Education 
(r=.60). Students passing the total coir5}rehensive 
examination also had significantly higher test scores 
than those who failed. 

9 Pot graduate students in Psychological foundations of 
Education at Teachers College, Columbia University, Lorge 
found the following correlations between the Doctoral 
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Education Examination and (EE scores: Verbal Ability, .63; 

(cont.) Quar.titative Ability, .32j and Advanced Psychology 

Test, .Ul. 

The following table presents the correlations obtained 
in the ten studies using grside-point averages as the 
criterion of graduate study success. 



Relationship between Predictora and Qradiiate Average Qrades 
for Students in Education 



(Abstract Correlation mitiple 

number) Institution Predictors with R 

Criterion 

32 Bradley University Adv. Ed. .3U 

25 '"Eastern Graduate Sch." V .26 

2U Florida State 

University V *Uo 

Q .U6 

18 Florida State 

university V *36 

Q .30 

31 Sacramento State College 

Adjriin. & Supervision . V MS 

Other Ed. Fields Q .69 

28 South Carolina State V & Q .3U 

College Adv. Ed. ^9 

Ug, Adv. Ed. .57 

29 University of Detroit V .2? 

Q .23 

V & Q .33 

23 Utah State University V .36 

Q .37 

22 West Va. University V .23 

Ug, V .32 

30 Winona State College Ug, Adv. Ed. .30 



Ug, Adv. Ed., MAT .52 
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Education l8 Using faculty ratings on each of five qualities 
(cent. J separately, Harvey obtained the foUowtng corre- 

lations with the Verbal Ability score at Florida 
State University. 



Qgality Rated 

I>\mdaiiiental ^ovledge 
Basic Research Techniques 
Ifritten Expression 
Intellectual Breadth 
Overall Quality of Work 



Correlation 

.63 
.53 
,66 
.62 
.62 



1? At the University of Oklahoma, Rupiper used attainment 
of the doctorate as the criterion of success and found 
the Verbal Ability and Advanced Education Test scores 
significantly higher for the successful than for the 
unsuccessful graduate students in education. 



Engineering 



Correlations of .U7 and .?1 were found by Besco at 
Purdue University for civil engineering and indus- 
trial engineering respectively between Verbal Ability 
scores and faculty ratings of success. 

In the study of National Science Foundation fellowship 
awardees, Creager used doctorate attainment as the cri- 
terion. For engineering students he foxind a biserial 
correlation of .U5 between the Advanced Engineering 
Test score and the criterion'. Correlations of *Ul and 
.31 ware found for the Verbal Ability and Quantitative 
Ability scores respectively. 



English 27 A study at Princeton University revealed that the Verbal 

Ability and Advanced Literature Test scores were each 
useful in predicting performance in graduate study. The 
investigator concluded that a^iplicants with low scores 
on either test had low probabilities of success* Ftour- 
f ifths of those with scores of 700 or above had above 
average or average course performance. 

Forestry 12 One study was published in 19?? based on data for 33 

students in a one-year Master of Forestry program at 
Yale. Correlations obtained were as follows: 
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Ebrestry 



Predictors 

Verbal AbiUty 
Qaantitative Ability 
Advanced Biology Test 



Correlations with Correlations with 



Average C^ades 
.33 
.56 
.35 



Psicultjr Ratings 
.25 
.63 
.22 



Best wei^ted 
Combination of Above 



• 62 



.6k 



Geology 21 Performance on the a^aduate Record Examinations was 

found to be related to success in graduate study in 
geology at Tale* A conf>osite rating by faculty mem- 
bers of each of 76 students constituted one criterion* 
The score on the Advanced Geology Test was the best 
single predictor. 



Predictors 
Verbal Ability 
Quantitative Ability 
Advanced Geology Tfest 



Correlation with Ratings 
*32 
*38 
.51 



Best wei^ted 
Combination of Above 



.5U 



It was also found that 68 percent of those with scores 
of 600 or above on the Advanced Geology Test had earned 
either the Ph*D* or a Ifaster's degree while only 31 per- 
cent of those with scores below 600 had done so. 

Using doctorate attainment as the criterion j Creager's 
study of National Science Fbundation fellowship awardees 
revealed the hi^est correlation for Verbal Ability 
(r=.Ul). The correlation was .37 for Qaantitative 
Ability and .2? for the Advanced Geology Test score. 



History 



31 



Two studies reported data separately for the field of 
history, both using graduate average grades as the cri- 
terion. At Sacramento State College a significant cor- 
relation of .57 was found for the Advanced History Test. 
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History 
tcont* ) 



25 A correlation oi" *U7 was found for the Verbal Ability 

score at an "Eastern a^aduate School'** Only the ^titude 
Test was used as a predictor in that study* 



Industrial 
Education 



The Verbal Ability and Quantitative Ability scores of 
successful doctoral candidates were found to be signif- 
icantly higher than those for unsuccessful candidates 
in a study of graduate students in industrial education 
at Wayne State University* 



32 At Bradley University, Robinson obtained a significant 
correlation of between the Advanced Education Test 
score and graduate average grades in industrial arts 
education* 



library 2U Fbr a group of 29 graduate students in library study at 

Florida State University, it was found that the correla- 
tion with graduate averag^ grade was *U8 for Verbal 
Ability and *U5 ^or Quantitative Ability* The sum of 
these two scores yielded a correlation of *57 with the 
average grades* 



Mathematics 31 Scores on the Advanced Mathematics Test yielded a 

statistically significant correlation of *76 with 
graduate average grades at Sacramento State College* 

h Creager found scores on the Advanced Mathematics Test 
to be substantially correlated (r=*U7) with a criterion 
of doctorate attainment for National Science Foundation 
fellowship recipients* 

25 A correlation of *U6 was obtained by Madaus at an 
"Eastern a-aduate School" between the Quantitative 
Ability score and graduate grade-point average* A 
combination of the Verbal Ability and Quantitative 
Ability scores and the undergraduate average yielded 
a multiple correlation of *69 with the graduate grades* 



Meteorology 2U Fbr a group of U students at Florida State University, 

the correlations with graduate grade-point average were 
*59 for Verbal Ability and *U8 for Quantitative Ability* 
The sum of the two scores yielded a correlation of *599* 



Music 2k At Florida State University the Verbal Ability score 

showed a correlation of *37 with graduate average grades* 
The correlation for Quantitative Ability was *25* 
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Nursing 2? Madaus found a significant correlation of *33 between 

Quantitative Ability and graduate gradfj-polnt averages 
in the nursing departanent at an "Eastern (5:aduate School*" 



Occupa- 
tional 
Therapy 



26 Fbr graduate students in occupational therapy at the 
University of Southern California, significant cor- 
relations of *31 and *U9 respectively were obtained 
between the Verbal Ability and Quantitative Ability 
scores and graduate grade-point averages* A corre- 
lation of vas obtained between the grade averages 
and the sum of these scores* 



Phamacy 



Faculty ratings aiil the Quantitative Ability scores 
yielded a correlation of *38 for graduate students 
in pharmacy at Purdue University* 



Physics 



U Fbr National Science Foundation fellowship awardees 
In Physics, Creager found the scores on the Advanced 
Physics Test to be more hi^ilj predictive of doctorate 
attainment than either the Verbal Ability or Quanti- 
tative Ability scores* The correlations were *19 and 
*33 for these two Aptitude Teat scores respectively 
and *Ul for the Advanced Physics Test* 

19 At the University of Chicago, graduate students in 
physics who had obtained the Fh*D* degree or who had 
passed the cai^didacy examination had a higher mean 
score on the Advanced Physics Test at the time of 
admission than did those who were asked to discon- 
tinue because of low grades or had failed at two 
atteirpts o,t the candidacy examination* 

U Michels made separate studies in the physics depart- 
ments of two universities, studying the relationship 
between the Advanced Physics Test and the Aptitude 
Itest scores and graduate performance in physics* The 
relationships were studied after one year of graduate 
study and again at the end of a three-year period* 
The Advanced Physics Test and the Quantitative Ability 
scores were found to be quite highly predictive in one 
institution but less so in the other* The author con- 
cluded that "* * .candidates with scores above 600 to 
650 on the (RE Advanced Physics Test have a much greater 
probability of doing satisfactory work in physics than 
those with lower scores." 
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Pgychology T^ie reaulta of studies in the field of psychology shew 

that the test scores are positively and usefully rela- 
ted to level of performance in graduate study. It also 
^ipears that in general the Advanced Psychology Test, 
where used^ was somewhat the best predictor. 

It For Ifotional Science Foundation fellowship winners^ 
Creager foxind the Advanced Psychology Teat to be the 
best predictor of doctorate attainment. 

^ Using pass or fail on the doctoral candidacy examina- 
tion as A criterion, Qorman obtained a biserial cor- 
relation of .62 between it and scores on the Advanced 
Psychology Test at New Ibrk Ibiiversity. 

Hie correlations obtained by other investigators between 
the test scores and various criteria are shown in the 
foUowing table. 



Relationship of Test Scores with Performance in aradaate 

Study in I^chology 



(Abstract 
nunber) 



2h 

32 
16 

13-lli 



Institution 



Purdue Univ. 
Clinical 
Eipertmental 
Bbqierimental 

Florida State 
Qiniverslty 



Bradley Univ. 
Univ. of Maml 

New Tork Univ. 
Uhlv. of Florida 



Predictor (s) 



Oorrelation ifith 

Dept'l 
arades Ratings Enuns 



V 
V 
Q 

V 
Q 

7 & Q 



Adv. Paych. 

V 
Q 

Adv. Psych. 



Adv. P^ch. 

7 & Q 

Ug, V & Q 
Ug, V & Q, MAT 



.55 
.60 

.6a 

.59 



.23 
.37 



.32 
.U7 
.57 



.29 
.32 



.32 
.2U 
.56 



.5U 
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Sociology 2 Only one of the studies reviewed in this report 

included a study of graduate students in sociology* 
At Purdue, Beaco found a significant correlation 
of *$6 between the Quantitative Ability acore and 
faculty ratings of the graduate study performance 
of 2h students* Advanced Test acorea were not uaed* 



n 
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STUDIES EMPIDHNG VARIED CRITERIA OF SUCCESS 



BENSON (2), in a study coin)leted at WAYNE STATE UNIVERSITY in 
1958, studied 56 doctoral candidates in INDUSUIIAL EDUCATION* 
TVenty-five had coirpleted all requirements for the degree and 
were designated "successful'** The remaining 21 were classified 
as "unsuccessful^', ha/ing left before satisfying the degree 
requirements * 

Enqploying analysis of variance, Benson found statistically 
significant differences (at the *01 level) between the two 
groups with respect to their CRE Verbal Ability scores, their 
Quantitative Ability scores, and scores on the-Miller Analo- 
gies Tfest* 

BESCO (U) conducted a study at PURDUE UNIVERSITY, separately 
in each of seven departments, investigating the relationship 
between scores on the <SiE Aptitude Test and success in gradu- 
ate study* The criteria were grade-point averages and special 
ratings by the faculty* Paired-conparison ratings were obtained 
from staff members on overall performance* 

Correlations significant at the *05 confidence level were 
obtained between Verbal Ability scores and paired-coin)ari3on 
scores for students in the departments of chemistry Cr»*23^ 
N=82), civil engineering Cr=*U7* N=26), industrial engineering 
Cr=*5l, N=l6), clinical psychology Cr=*32, N»Uo), and experi- 
mental psychology Cr-*U7, N=20)* 

Significant correlations between Quantitative Ability scores 
and. the criterion were obtained for the students in agronoir^y 
Cr=*30, N=U2), chemistry Cr=*27, N»82) , pharmacy Cr»*38, N-UU) * 
experimental psychology Cr»*57, N'20), and sociology Cr»*56, 
N=2U)* 

In an uipublished study reported by Lannholm (15), BERGMANN (3) 
coin)ared scores on the Advanced Chemistry Test with graduate 
school performance of 59 students in the TALE UNXVERSITT CHEMISTRT 
DEPARTMENT* The criterion of performance was a rating based 
on actual grades in course work and evaluation by the student's 
research adviser* The ratings were defined as: A-above average, 
very good to superior, above 88; B^average, the good reliable 
students, 78-88; C=belOfw average, if not poor, below 78* The 
Advanced Chemistry Test scores were classified into three groups: 
above 790, 700-790, and below 700* 
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Of the 11 students who rated A, 82 percent had scores 
above 790 and l8 percent below 700. Thirteen percent 
of the 30 students rated B scored above 790, 63 percent 
between 700 and 790, and 23 percent below 700. Of the 
l8 C students, 6 percent scored above 790, 22 percent 
between 700 and 790, and 72 percent below 700. 



In a coirprehensive follow-up study of applicants for 
NATIONAL SCIENCE PDUNDAHON GRADUATE FELI0WSHIP3 in 
the sciences, CREAGER (8) used attainment of the doc- 
torate as the basic criterion of success in graduate 
study. Starting with approximately Uj500 fellowship 
applicants, he selected a stratified sample of 2,U88 
with scores on the Advanced Tests corresponding to 
those of the candidates tested in the CUE National 
Program for C^aduate School Selection in 1960-1961. 

Por each of three test scores (Advanced Test, Verbal 
Ability, and Quantitative Ability) he plotted curves 
to show the relationship between rate of doctorate 
attainment and level of test performance. This was 
done separately by different fields of study and by 
sex within each field. In general, the curves based 
on the Advanced Test scores "...show a generally steady 
increase in the probability of doctorate ^.ttainment as 
the test performance level increases." Although the 
relationships in the case of Verbal Ability and Quan- 
titative Ability were less marked than for the Advanced 
Tests, they were nevertheless positive. 

Correlation coefficients were also coirputed between 
teat scores and three different versions of the doc- 
torate attainment criterion. These included biserialj 
point-bisorial, and multiple correlation coefficients. 
The validities obtained were highest for the Advanced 
Test in all but two subgroupss males taking the Advanced 
Biology Test and males taking the Advanced Geology Test. 
These differences were not statistically significant. 
Combining the threo scores resulted in amall increases 
in the multiple correlations which were consistently 
higher than the validities obtained for the Advanced 
Test alone. 

In the same report, Creager also describes a study 
based on a group of 3,U9l applicants for 1955 and 
1956 fellowships. Jbr these subjects the data used 
\to predict doctorate attainment were the GRE scores, 
' *graduate grade point average in science and 
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mathematics^ and reference -report average ratings* The 
effectiveness of various combinations of these predictors 
was also evaluated. 

The validity coefficients obtained for the Advanced Test 
ware highest in most instances. Next hi^est were those 
for Quantitative Ability* Those for grade-point averages 
and reference-report ratings followed and were of about 
equal magnitude. With respect to the various combinations 
of predictors, the author concludes; 

"*..it appears that the Advanced Test usually 
does just about as well as does the three-test 
coir^Dosite, although in the 'more verbal fields 
such as biology and psychology, the Verbal Test 
does add a little to the prediction* Beyond 
this, the addition of grade-point average and 
ref ereXiQe-report ratings makes . little difference, 
and when one is added, no further gain is made by 
adding the other. ^' 

In his suimary of the two studies the author concluded, 
in part; 

"Both studies confirm that the Graduate Record 
Examinations .have significant validity for pre- 
diction of doctorate-attainment criteria, even 
within the upper levels of test performance. 
Both studies confirm the greater validity of 
the Advanced Test over the Aptitude Teat*" 

? As early as 1953, OORMAN (lO) coin)leted a study involving 

PSICHDIDGT students at NHW YORK UNIVERSITI who had taken 
at least four graduate courses* Predictors included (RE 
Aptitude Test and Advanced Psychology Teat scores as well 
as scores on the Miller Analogies Test* As criteria of 
graduate school success, he used graduate grade-point 
average and paas-or-fail performance on the preliminary 
qualifying examination for doctoral candidacy* 

Only the Verbal Ability (r=*23) and Advanced Paychology 
Test (r=*37) scores yielded statistically significant 
correlations with grade-point averages, the former being 
significant at the *05 level and the latter at the *01 
level* Biserial correlations between the pass-and-fail 
groups were *62 for the Advanced Psychology Test and *l43 
for the Miller Analogies Test, both significant at the 
.01 level* 



VARIED OlITERIA - Page 22 



6 Smnmariz ing fourteen years of research on fellowship 

selections for the National Science Foxindation, HARMON 
(n) iiicluded a report of results obtained iJi studies 
designed to predict on-the-job effectiveness following 
doctorate attainment. Positive but relatively low cor- 
relations were obtained between Advanced Test scores 
and each of three criteria; publication counts, citation 
counts, and on-the-job ratings. 



7 In their study of 119 doctoral candidates who had received 
PURDUE Research Foundation fellowships be+wet., September 
1956 and September 1958, ONO and BESCO (lU) asked faculty 
members to rate each student on his overall performance in 
graduate work, and to indicate whether or not '^they would 
have recommended the ratee for a fellowship had they known 
how he would perform as an X-R Fallow*" Students were than 
ranked within their own departments on the basis of the 
faculty ratings, their grade-point averages, and their (jRE 
Aptitude Test scores* 

Critical ratios significant at the .05 level were found 
between rank on Verbal Ability and rank on faculty rating, 
aa well as between Verbal Ability and a coBiblnation of 
07ade-point average and faculty rating. None of the criti- 
cal ratios using Quantitative Ability were statistically 
significant. 

A phi-coefficient of *3U, significant at the *01 level, 
was obtained between the Verbal Ability scores and faculty 
ratings* On the basis of variance tests for both the 
Verbal Ability and ^Quantitative Ability scores, it was 
recommended that cut-off scores for admissions purposes 
be establish, 'd on a departmental, rather than a university- 
wide, basis* 

8 lAltf (l7) conducted a study that involved U6 doctoral 
candidates in the SCIDOL OF EDUCATION at the UWIVERSITY 
OF SOUTHERN CAUPORNIA. As predictors he used scores 
on the C3iE Aptitude Test and on the GRE Area Tests* 

Tt\e criteria were ratings on the school's five coirpre- 
hensive examinations, four of which were in ffi-story 
and Philosophy of Education, Educational Psychology and 
Quidanca, Administration, and Curriculum* Tt\e fifth 
consisted of the total comprehensive examination, which 
partially determined admission to the program for the 
doctorate* 
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Of the total groijp of U6 students, 2k failed and 22 passed. 
The guccessful students scored significantly higher (at 
the .01 level) on all predictors and on all criteria. Fbr 
the total group, the best predictors of the total conpre- 
hensive examination rating were the Verbal Ability and 
Social Sciences (in the Area Tests) scores, each correla- 
ting .72 with the criterion. 

The Verbal Ability score was the beat predictor of the 
examination rating in -Educational Psychology and Quidance 
Cr=.68) and in History and Philosophy of Education (r».60). 
The score on the Social Science Test predicted the examina- 
tion rating most effectively for Administration Cr=.56) and 
Curriculum Cr=.63). 



9 Using the score on the doctoral written examination as the 

criterion for l65 graduate students majoring in Psychological 
Fbimdations of EDUCATION at TEACHERS OOLIEGE, COLOMBIA UNTVER- 
SITT, IDRGE (18) obtained correlations of .63 with (RE Verbal 
Ability score, ,32 with Quantitative Ability, and .Ul with the 
Advanced Psychology Test score. 



10 MICHAEL et al (21) used a departmental background examination 

as the criterion in a study involving hX graduate students in 
CHEMISIIIY at the UNIVERSITY OF SOUTHERN CALIFDRNIA. The eacam- 
Ination consisted of three subtests* Inorganic Chemistry, 
Organic Chemistry, and Physical Chemistry. The predictors 
were scores on the CjRE Aptitude Test and on the Area Tfests. 

Observing that the mean scores on the Quantitative Ability 
and the Natural Science Test were very high (6U3 and 6U2) 
aiid the standard deviations quite small (72 and 76), the 
investigators used 100 as an estimate of the standard devi- 
ation of an uncurtailed group of examinees^ and reported 
that ^'statistically significant correlations of .55 for 
Quantitative, .U2 for Verbal, .32 for Ifamanities, and .31 
for Natioral Sciences were obtained with B.E. -Physical and 
a coefficient of .33 between OtE-Natural Science and B.E.- 
Inorganic*" 



11 A special study of the predictive effectiveness of the 

Advanced Physics Test and the Aptitude Test in the PffiTSICS 
departments of two graduate schools was reported by MICHELS 
(22) in 1966. An overall rankling (separate in each depart- 
ment) on performance after one year of graduate study was 
used as the criterion in the first part of the study. 
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Plotting the Advanced Test score for each student against 
his ranking index showed '*a fairly high correlation" for 
one institution and little or no correlation for the other* 
Similar analyses involving /^titude Test scores showed 
little correlation between Verbal Ability and the ranking 
index in either institution* 

The use of Quantitative Ability as a predictor gave results 
similar to those obtained with the Advanced Physics Test 
score* Using the sum of the Advanced Physics Test and Quan- 
ti;tative Ability scores, a very high correlation was found 
for one institution and little or none at the second* 

Hie investigator also studied relationships between the test 
scores and grad\3ate school success of these students at the 
end of three years of graduate study. At one institution new 
ranking indices were conpiled in the same manner as before. 
At the other, classifications of status after three years 
were furnished. 

In the institution that was more selective in its adhiiissions, 
the correlations were again essentially non-existent. In the 
other, the correlation between A^anced Physics Test scores 
and status classifications after three years was higher than 
the correlation between those scores and the ranking indices 
after one year of graduate study. 

The author concludes that both the Advanced Physics Test 
scores and the Quantitative Ability scores appear to be 
good tools in the selection of successful graduate students. 

12 OLSEN (25) conducted a study of U3 students in the YALE 

SCHDOL OF FORESTRY between 1951 and 195^^ who had taken 
both the CEE /^titude Test and the Advanced Biology Test 
in October, 19U9, or later. The criteria used were grad- 
uate grade-point averages and the averages of ratings of 
prof ess.! onal con5)etence made by sijk faculty members on a 
sero-to-four scale. 

'Riirty-three of the students were in a one-year Master of 
Forestry program, having majored in forestry as undergrad- 
uates. The remaining ten were in a two-year program. The 
graduate grade-point average of the students in the two- 
year program was based on their second year of study. 

The Quantitative Abili ty . scores of all U3 students correlated 
.52 with faculty ratings and .51 with graduate grade-point 
average. The Verbal Ability scores showed correlations of ,39 
and .37 with faculty ratings and grade-point averages respec- 
tively. The correlation between Advanced Biology Test scores 
and faculty ratings was .30 and was .27 with grade-point averages 
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When the 10 two-year program students were omitted from the 
san5>le, higher correlations were obtained between Quantita* 
tive Ability and faculty rating Cr=.63), Quantitative Ability 
and grade-point average Cr=.56), and Advanced Biology Test 
score and grade-point average Cr=.35). Smaller correlations 
were obtained between the other pairs of variables. 

Multiple correlations of the best-wei^ted combination of the 
three predictors yielded coefficients of .56 with faculty 
ratings and .55 with grade-point averages for the total san^jjja. 
Fbr the one-year program group, the coefficients were .614 with 
the ratings and *62 with average grades* 

13 In 1961, HDBERTSON AND NIELSEN (28) reported the results of a 

study in which special faculty ratings were obtained as cri- 
terion measures. The subjects were 50 students who had entered 
. graduate.study^.iQ PSJECHOIDGE at. tha^UMIBEESITtQF. F[ORIM._ 
between 1955 send 1959 and for whom <S(E /^titude Test scores 
were available. 

Each student was rated by nine faculty members on his intellec- 
tual capacity to obtain the Ph.D. degree. None of the raters 
knew the student's C31E scores nor the purpose of the atudy. A 
five-point scale was used: 1 - hi^sst ten percent; 2 - hi^est 
third excluding top ten percent; and 5 - lowest ten percent. 
Each faculty member also indicated his fairiiliarity with the 
student on a five-point scale that ranged from "general inpression'^ 
to familiarity with the student through courses and with his 
performance on con5)rehensive examinations. 

The correlation between mean ORE score and ratings was *29; 
between undergraduate average grade in mathematics and science 
and the ratings the correlation was ,37 (both significant at 
the ^05 level)* A multiple correlation of these two predictors 
with the ratings gave a coefficient of .UUj also significant at 
the .05 level. 

When the mean (RE scores were broken down into five levels 
and the mean ratings into seven, it was found that no student 
with a mean C3tE score of 655 or above had a mean rating below 
3.3 (the upper limit of the middle i*ating level); no student 
with a GRE mean score above 600 fell in the lowest rating 
level; and no student with a GRE mean score below 590 achieved 
the highest rating level. 



Hi In a study reported in 19614, ROBERTSON AND HALL (27) added 

data on 23 more recent graduate students in PSTCIDIDGr at 
the UNry^ERSlry OF FijORlDA to the Roberston and Nielsen (28) 
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study and than analyzed the data for the augmented san^le. 
The criteria again included a faculty rating on capacity 
to receive the Ph.D. Added criteria were scores on a com- 
prehensive examination given at the end of the second year, 
and peer ratings by 10 graduate students of the 23 at the 
end of the first year. 

Fbr the augmented sanple of 73 students, a statistically 
significant correlation (at the .0? level) ol" .2? was 
obtained between mean ORE (7 plus Q) scores and the faculty 
ratings. The correlation of .1? between the undergraduate 
average and faculty ratings was not statistically signifi- 
cant. None of the predictors correlated significantly with 
scores on the comprehensive examination or with the peer 
ratings, many of which yielded observed negative correlations. 

A Selective index based on a weighted combination of the mean 
(jRE score, the Miller Analogies Test score, and the under- 
graduate grade-point average for the junior and senior years 
yielded a correlation of .32 CN-U2) with faculty ratings and 
•5U CN«19) with comprehensive examination scores* Both cor- 
relations were significant at the -O? level. 

The authors concluded that "...success in prediction could 
be iirproved to some extent by using a composite score that 
represents a combination of differentially wei^ted predic- 
tors.'* 



1? Receipt of the Ph.D. was used as the criterion of success in 

graduate study in an Investigation conducted by RUPIPER (30) 
at the UNTVERSITT OF OKLAHOMA in 1959. The subjects were 25 
candidates for the doctoral degree in EDUCATION. Each took 
the (jRE ^titude Test after a year of graduate study and the 
Advanced Education Test following a semester or more of grad- 
uate education courses beyond the Master's degree level. 
Twelve of the subjects received the Ph.D. degree and 13 
failed to do so. 'Rie mean Verbal Ability score and the mean 
score on the Advanced Education Test were significantly 
higher (at the .0? level) for the successful candidates than 
for the unsuccessful. 



16 At the JNIVERSITZ OF MIAMI, SISTRUNK (31) reported correla- 

tions of .32 and .2U between Verbal Ability and Quantitative 
Ability scores respectively, and performance on the depart- 
mental coirprehensive examination for 57 graduate students in 
PSYCHDIDGT. Fbr 73 students, he obtained a correlation of 
.56 between the departmental examinaticn and scores on the 
Advanced Psychology Test. 
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17 fecial ratings were also obtained by T^TTJT (3U) in a study 

carried out at FIJORIDA STATE UNIVERSITT using data on a 
basic sanq;>le of 1^U7? students admitted to graduate study 
between July 1, 1955* and September 30, 1958. Separate 
studies by department were not made* 

Ratings of success in graduate study (on 958 students) were 
made by their major advisers on an LL^oint scale of five 
qualities: "degree of mastery of fundamental knowledge in 
the general field; knowledge of, and ability to use, the 
basic research techniques in the field; ability to e:xpress 
oneself in writing; inteUjectual breadth; and overall quality 
of graduate mrk«*' Qrade^oint averages in graduate study 
constituted another criterion* The predictor variables inclu- 
ded the undergraduate grade^oint average and scores on the 
0{K /^titude !fost. Advanced Tests, and Area Dasts, and on the 
Miller Analogies Tbst. Not all predictor data or criterion 
data were available for all of the students* 

Despite the pooling of data for the various departments, all 
of the correlations obtained between the predictors and the 
criteria were significant at the •05 level or better, except 
for that between the scores on the Natural Science Test of 
the Area Ibsts and the graduate grade^oint average. These 
correlations were based on samples of 333 to 1,073 cases and 
ranged from .08 to .Ul. 

To assess the effect of using various cut-off levels on the 
predictors for admissions purposes, mean criterion values 
(separately for faculty ratings and graduate grade^pint 
average) for different projected admitted and rejected groups 
were coiiqpared. Differences statistically significant at the 
«01 level were obtained in all con^arisons made« It was noted 
that raising the cut-off on any of the three variables had 
greater ijif)act on decreasing the percentage of those accepted 
than in increasing subsequent mean ratings or graduate grade* 
point averages « 

In testing the utility of a multiple-regression vs« a multiple- 
screening method of selection, the author found that "the imil- 
tiple-regrassion procedure for organizing predictive data, 
although failing to select students who performed better aca* 
demically than those selected by the multiple screen, led to 
a significantly higher proportion of correct decisions than 
the multiple screen*" Tt\e author also concluded* "A study 
designed to determine the relationship of subtest scores to 
grades in specific departments is needed as a possible approach 
for establishing differential deparlaiental-admissions strategies*'^ 
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18 Using Tally's data, H^.RVET (12) made a special analysis based 

on 89 graduate students in the Department of EDUCATION. His 
results showed a correlation of .3o between xmder graduate and 
graduate grade^^oint averages. The correlation with graduate 
average grade was .36 for Verbal Ability and .30 for Quanti* 
tative Ability. JUrther analysis using the faculty ratings 
as criteria yielded correlations from .28 to .37 with the 
xmdergraduate average. Substantially more favorable predic- 
tive effectiveness was obtained for the Verbal Ability score* 

Using the faculty ratings made on each student for each of 
five qualities separately, he obtained a correlation of .63 
with Flmdamental Knowledge, .53 with Basic Research Tech- 
niques, .66 with Written Ebcpression, .62 with Intellectual 
Breadth, and .62 with Overall Quality of Work. 



19 Another study in which successful and xmsuccessful classifi- 
cations were used was conducted by VDORHEES (35) and reported 
by lannholm Cl5). Data were obtained on 68 graduate students 
admitted to the Department of PHZSICS at the UKIVEElSITr OF 
CHICAQO from the fall of l95t> through the fall of 1956. The 
successful students were those who had obtained the Ph.D. or 
had passed the Ph.D. candidacy examination by autumn, 1958. 
Those students who had been asked to discontinue because of 
low grades or had failed at two attenpts on the candidacy 
examination were classified as xmsuccessful. Approximately 

92 percent of those with scores of 6OO or above on the Advanced 
Physics Test were in the successful group. Only 53 percent 
of those with scores below 6OO were successful. 

20 At HOWARD UNIVERSITT in 19^2, WALLACE (36) con^leted a study 
of two groups of graduate students, the first including IDO 
who entered in the fall of 19U9 and the second, 52 who had 
entered in the fall of 19U8 and were still enrolled. <SiE 
Verbal Ability and Advanced Test scores and undergraduate 
grade-point averages sexnrod as the predictors. The criteria 
eirployed were graduate grade-point averages and special 
teacher evaluations of each student on a 25*^oint scale. 

The predictors showed higher correlations in most cases with 
the tea^iher evaluations than with the graduate grade*^oint 
average. Ebr Group I, the correlations were* Verbal Ability, 
r=*35; Advanced Test score, r=*58; undergraduate average, 
r».57* Used togisther, the two (HE scores yielded a correla- 
tion of .59. A combination of the Advanced Test score and the 
xmder graduate average gave a correlation of .70. 
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21 In a stAidy of students at lALE UNIVERSITT (23) registering 

in the years 1952-1961 inclusive for graduate uorlc in OBOIDGr, 
the principal criterion was a conposite rating of the students 
by faculty members* Scores on the (PE /^titude Test and the 
Advanced Geology Test constituted the predictor variables. 

Using optlimim weights for the test scores as a **GBE Index", 
a correlation of ♦SU with the conposite ratings was obtained 
for 78 students* Advanced Geology Test score correlated 

•51 with tlie coii5>osite ratings; the (BE Verbal and Quantita- 
tive scores correlated .32 and •38 re^ectively with the 
ratings* 

Of those with scores of 600 or above on the A*/anced Geology 
Test, 68 percent had earned either the Ph.D. or a Master's 
degree; only 31 percent of those with scores below 600 had 
taken one of these degrees. 
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STUDIES EMPIDTENG GRADE-POINT AVERAGE AS THE CRITEKION 



22 The results of a study using graduate grade^^oint average as 
the criterion of success were reported by AI£XAKOS (1) • The 
study involved students in the COLIEGE OF HUMAN RESOURCES and 
EDUCATION at WEST VIRCKNIA UMIVERSlfl. Separate analyses were 
made of data collected for 92 students, U6 each in the Division 
of Clinical Studies and the Division of Education. 

Ebr the Clinical Studies group, correlations with the criterion 
were .3U for the /^titude Test Verbal Ability score and .31 for 
the undergraduate average. Correlations of .23 and .26 were 
found for these variables for the Division of Education students. 
Multiple correlations of .^2 and .32 were obtained for these two 
groups respectively. 

23 BORG C5) coirpleted a study in 1963 using data for 175 graduate 
students in EDUCATION at UTAH STATE UNIVERSITY, Most of these 
students were master's degree candidates jjn elementary education, 
secondary education, or educational acininistration. All had 
conpleted at least 15 hoiors of graduate work and had taken the 
(RE Aptitude Test within the preceding five years. 

Using graduate grade^^oint average as the criterion, Borg 
obtained correlations of .36 and .37 with the Verbal Ability 
and Quantitative Ability scores respectively. Ife noted that 
"since grades in many graduate courses are limited aluiost 
entirely to A or B, the discriniination value of the CPA ia 
reduced " 



2U A study involving 3lU students in thirteen different fields of 

study was carried out in 1958 by the Office of Institutional 
Research and Service, FLORIDA STATE UNIVERSITY C2U) • Students 
were included who had eight or more semester hours of graduate 
study, who had entered in the suinmer of 1953 or dioring 1953- 
195Uj ^d who had scores on the OtE /^titude Test. The cri- 
terion en^loyed was a graduate grade^^oint average that varied 
from 2.U to U*0 with a mean of 3.U* T^e number of cases per 
field of study varied from seven ia hojne economics to 96 in 
education, with the remainder falling between 11 in meterology 
and 26 in music* 

Because of the small numbers of cases, the correlations between 
test scores and graduate grade^^oint averages were subject to 
large saiq^ling errors* The total ORE score (V plus Q) showed 
correlations ranging from nearly .65 for psychology CN-23) to 
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-.12 for social welfare CN-20) . Rirther analysis ahowed 
that among the students with GRE scores in the highest 
decile, 79*7 percent of the grades were **A**; among those 
in the lowest decile, only 32 percent of the grades were 
"A". 



25 A study by MADAUS AHD WAI£H (20) investigated the differences 
in predictive validity of the ORE Aptitude Test among various 
depar-hnents in the same graduate school, draduate grade-^oint 
average was used as the criterion. 

Statistically significant correlations were obtained between 
Verbal Ability and the criterion for the departments of 
chemistry (r^.tU^), economics (r^.Uo), history Cr".U7), and 
education Cr=.26) . Fbr Quantitative Ability, statistically 
significant correlations were obtained for the nursing depart- 
ment Cr^.33) and the mathematics department and mathematics 
institute combined Cr*.U6). A nmltiple correlation of .69 
between (SiE scores and grade-point averages was obtained for 
the mathematics institute. 

26 SIEEPER (32) studied the relationship between GRE Aptitude 
Test scores and graduate grade^^oint averages for 2U women 
who received Master*s degrees in OCCUPATIONAL THERAPY at 
the UNIVERSITY OF SOUTHERN CALIPORNIA* He obtained a cor- 
relation of .31 (significant at the .05 level) for the Ver- 
bal Ability score and of M9 (significant at the .02 level) 
for Quantitative Ability. A correlation of .5U (significant 
at the .01 level) was obtained between total score (V plus Q) 
and grade^^oint average. 



27 An analysis of the graduate school performance of Uh stu- 

dents in ENGUCSH was made by TTORPE (23) and reported by 
Lannholm (15) • AH of the students were admitted during 
the period 1950-1955* had coiipleted the course work 
for the doctorate. Hie CRE Aptitude Test and the Advanced 
Literature Test had been taken by aU prior to admission. 
Performance in graduate course work was the criterion. 

Hie Quantitative Ability scores showed little relationship 
with graduate school success. However, 80 percent of the 
students with Verbal Ability scored of 7OO or higher had 
average. or above-average performance in graduate courses. 
Of those with scores below 700, approxijnately 6I percent 
had below^verage course grades. For the Advanced liter- 
ature Test, 82 percent of those with scores of 7OO or higher 
were average or above in their course performance. 
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Ainong the author's conclusions was the atatomfintt 

"The predictive ability of the ORE scores alone 
is about as good as a coinbination of all of the 
other information regularly suj^lied, including 
academic records and letters of recoittttiendation^ 
even after adjustment in the light of knowledge 
of the institutions and the recoramenders*" 



28 Using undergraduate grade^^oint averar;'3s and (S£ scores as 

r predictors and graduate average jarat^as as the criterion, 
CAPPS AND DiECOSTA (6) studied hX graduate students nho had 
enrolled at SOUTH CAROLINA STATE COUEOE between 19U8 and 
195U and who had conpleted the four basic professional courses 
required of all graduate students* 

A correlation of .U2 was obtained between undergraduate grade- 
point average and graduate average grade. For the total score 
(V plus Q) on the Aptitude Test, the correlation was .3U- A 
correlation of ^1x9 was obtained for the Advanced Education 
Test. A multiple correlation coefficient of .?7 was obtained 
between the criterion and a combination of the undergraduate 
average and the Advanced Education Test score* 



29 At the UNTVERSirr OF DEIHOIT, COHWAT (7) used data of 36 

students receiving Master's degrees in EDUCATION. Under- 
graduate average^ (HE Aptitude Test scores^ and the score 
on the Advanced Education Test were used as predictors. 
The criterion was the grade^^oint average in graduate edu- 
cation courses* 

Hie best single predictor was the undergraduate grade*^oint 
average in all courses (r*.^7)^ followed by the undergraduate 
average in education courses Cr**U9)* Verbal nHbility cor- 
related .27 with the criterion. Quantitative Ability, .23, 
total Aptitude Test score (7 plus Q), *33» and the Advanced 
Education Test, 



30 ECKHDFF (9) used 185 secondary EDUCATION and m elementary 

education majors with 30 or more quarter hours of graduate 
work at WINONA STATE COLLEGE as her sanple. Predictor vari- 
ables included the undergraduate average^ (SE Advanced Edu- 
cation Test, and the Miller Analogies Test. The criterion 
was the overall graduate average. 

Using stepwise multiple -regression analysis, a multiple 
correlation of .52 was obtained using all predictors for 
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ttie secondary education groijp. Fbr the elementary 
education majors, a imiltiple correlation of .30 was 
obtained between the criterion and a combination of 
the undergraduate average and the Advanced Education 
Test score. When the Miller Analogies score was inclu- 
ded, the value of the Jnultiple correlation remained 
unchanged. 



31 At SACRAMENTO STATE OOLEEGE, JOHNSON AKD THOMPSON (13) 

coii5)leted a study in 1962 in which the predictors used 
wars the (RE Aptitude Test, the Advanced Tests, Tipper- 
division undergraduate grade-point average, and ttie 
number of years elapsed since earning the Bachelor's 
degree. The criterion was the grade-point average for 
all graduate study. Although the number of students in 
most subject fields was small, analysis was done by major 
field as well as for all combined. 

The authors report a restricted range of graduate grade- 
point averages and of <FE scores. Correlations signifi- 
cant at the .05 level were obtained between the criterion 
and Verbal Ability for the fields of art (r".72), educa- 
tional administration and 3i5)ervision Cr=.U5), and busi- 
ness administration Cr=.36). Fbr Quantitative Ability 
the significant correlations were in the field of art 
Cr=».72) and "other education" Cr-.69). The Advanced Test 
showed significant correlations for history (r=.56) and 
mathematics (r=.76). 

The undergraduate average yielded significant correlations 
for art Cr=.63), business administration Cr«.U6), educational 
administration and stpervision Cr=.38), other education (r^.^O), 
and physical education Cr=.59). With respect to years since 
receiving the bachelor*s degree, significant correlations were 
obtained for history (r=.U3), physical education (r=.50), and 
social science Cr=.7l). fill involved small numbers of cases. 



32 In a study coii5)leted in 1957, ROBINSON (29) reported results 

based on 285 graduate students who had entered BRADLEY 
UNIVERSITT between 19U7 and 19U9 and who had coirpleted at 
least one year of graduate study. Analyses were made by 
field of study and for the total. Predictors used were 
undergraduate grade-point average and scores on ttie C31E 
Aptitude Test and Advanced Tests. The graduate grade- 
point average was used as the criterion. 
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Correlations significant at the .01 level were obtaiiied 
between the criterion and undergraduate grade-point average 
for education (r=.39), social studies (r=.53), psychology 
(r=.63), natiaral sciences (r=.68), and total grovp (r*.38). 

Also significant at the .01 level were the correlations for 
the Advanced Test score for industrial -arts education (r'.3U), 
psychology (r=.59), natural sciences (r'.68), and total grovp 
(r=.23). ^tiltiple correlations were not obtaiiied. 



33 ELIZABETH WHITE (37) used 3? students receiving the M.S. 

degree in CHEMISTRY at the UNIVERSITT OF DETROIT for a 
study in which the graduate average grade was enployed 
as the criterion. The predictor variables included the 
Overall undergraduate grade-point averags^ the under- 
graduate average in chemistry courses, and scores on the 
OlE /^titude Test and the Advanced Chemistry Test. 

The correlations between the predictors and the criterion 
ranged from .iiO to .Ui, except that the correlation obtained 
between Verbal Ability and the criterion was .28. A multi- 
ple correlation of .63 was obtained between the criterion 
and the "^best" combination of the Advanced Chemistry Test 
score. Quantitative Ability score, and the undergraduate 
average in chemistry. 



3U GORDON WHITE (38) completed a study at the UlTIVERSITr OF 

IOWA in 1967. Pooling data across departinents for four 
groups and using graduate grade^oint average as the cri- 
terion and the CKE V and Q scores as predictors, he obtained 
a multiple correlation of .33 for those beginning an M.A. 
program, .UO for those receiving an M.A., .31 for those 
beginning a Ph.D. program, and .12 for those receiving a 
Ph.D. All but the last were statistically significant at 
the .05 level. 

Multiple correlations (significant at the .05 level) of .28 
and .36 respectively were obtained for beginning doctoral 
students and those receiving the Ph.D. in education. A 
cross-validation study yielded correlations ranging ft-om .35 
to ,U5 between predicted and earned grades for groT:p3 of 
students receiving degrees in August, 1966. 
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Predicting the graduate firtudy performance of foreign 

students in U, S. institutions is eqjecially difficult.^ 

While it would be unreasonable to ejcpect that this can [ A 
be done satisfactorily by means of test acores only^ it\ 
seems desirable to make some assessment of their possible 7 
contribution to the selection of foreign students* OnlyX 
two studies were found which dealt with this problem* ( 

3^ HAfi^aiLT (19) collected and analyzed data for 250 male 
students^ randomly selected from all fio^ish -speaking 
foreign graduate students who had enrolled at the UNI- 
VEHSITT OP SOUTHERN CAUFDRNI/l between 1955 and 1961 
and who had (BE scores and criterion measures* The 
graduate average grade over a miniimim of two semesters^ 
totalling at least 12 unlts^ was eait>loyed as the cri- 
terion* 

These students were divided into tm grot^s and studied 
separately* Ihe first included lOU students tram countries 
where Ehglish is the primary language and the culture 
follows a pattern sljnilar to those with Western civilisa- 
tion* Included In the second group were H^S students 
ft*om countries where Ehglish is not the first language 
and the culture differs from those In the other group* 
Neither of these gro^s was subdivided by field of study, 

Bivarlate correlations obtained between the criterion and 
Verbal Ability were *13 for Qroup I and *23 (significant 
at *01 level) for (iFoup H* Fbr Quantitative Ability, the 
correlation was *10 for each grot^* Multiple correlations 
using a combination of Verbal Ability and Quantitative 
Ability were *13 and *23 for Qronjs I and II respectively* 

Using discriminant function analysis, the test scores, 
weighted to maximize their ability to separate the top 
27 percent and the bottom 27 percent, yielded a biserlal 
correlation of *16 for (Itoup 1 for a conposite of Verbal 
Ability and Quantitative Ability* A biserlal correlation 
of *39 (significant at the *01 level) was obtained for 
Qrot^ II* 
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36 A study including foreign graduate students at four dif- 
ferent universities was conducted by PITCHER AND HAKVEY 
(26). All of the students were from countries where 
English is not the principal language. The criteria used 
were graduate average grades and special ratings by faculty 
manibers* Information concerning the graduate school status 
(e.g., earned Ph.D», still enrolled, withdrew, etc.) was 
also obtained for these students. 

TBie correlations obtained between graduate average grades 
and tests scores, and between those grades and the special 
faculty ratings, varied from one of the graduate schools 
to another. 

In a school in which 221 cases were used, the correlations 
between faculty ratings ware .33 and .38 for Verbal Ability 
and Quantitative Ability respectively (both significant at 
the .01 level) . The multiple correlation of a combination 
of the test scores with the ratings was .U3. Corresponding 
correlations using the graduate grade averages as the cri- 
terion were .25, .Ui, and .U?. 

In a second school having 195 foreign students included in 
the study, the correlations with faculty ratings were .17 
for Verbal Ability and .lU for Quantitative Ability. The 
multiple correlation was .19. Using graduate average grades 
as the criterion, correlations of .lU and .U were obtained 
with Verbal Ability and Quantitative Ability respectively, 
the multiple correla^tion being .16. 

Conparisons of levels of test performance and educational- 
status classifications revealed a strong positive relation- 
ship in two of the three institutions with sufficient 
numbers of cases for such analysis. 
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